i/1 


I  AD-A148  922  MULTI  TARGET  TRACKING  BV  DYNAMIC  SCENE  ANALYSISCU) 
MASSACHUSETTS  INST  OF  TECH  CAMBRIDGE  LAB  FOR 
I  INFORMATION  AND  DECISION  SVSTEMS  T  KRONHAMN  AUG  84 

I  UNCLASSIFIED  LIDS-P-139?  N00014-77-C-8532  F/G  17/9 


NL 


MICROCOPY  RESOLUTION  TEST  CHART 

NATIONAL  BUREAU  OF  STANDARDS- 1963  A 


•  rv  wj  v-j  w:  r,  y;  /  j  » 


k. 


L* 


AUGUST  1984 


MIT  Laboratory  for  Information  and 
Decision  Systems,  Cambridge,  MA 
Contract  N00014-77-C-0532  (NR-041-519 


MULTI  TARGET  TRACKING  BY  DYNAMIC  SCENE  ANALYSIS 

by 


AD- A 148  922 


Thomas  Kronhamn* 
Ericsson  Radio  Systeas  AB 
Sweden 


CL. 

o 

co 

IjU 
— J 

I  • _ 

C.V 

k~~ 

r  ** 


ctad 


Thistasaarch  was  com 
Visiting  Research  Scurf 
Information  and  Dacision 
providad  by  tha  Office 
contract  ONR/N00O14-77-C-0S3, 


stems 


while  the  author  was  a 
at  the  MIT  Laboratory  for 
with  partial  support 
Research  under 
(NR041-319)  ^ 

"S  \  '  »  y 

J  ct \t.  y  \ 


of  tfkval 


LIDS-P-1397 


DTIC 

ELECTE 
Of  C  1  9 1984 


1.  Introduction 

Miltitarget  tracking  is  dealt  with  in  numerous 
papers  over  the  last  ten  years.  Specific  review  papers 
can  be  found  in  [1]  to  [5].  The  main  evolutionary  path 
has  come  from  the  "nearest  neighbor”  principle,  early 
"branching"  procedures  to  late  "hypothesis"  generating 
methods,  the  latter  represented  by  e.g.  [6].  These 
methods  suffer  from  excessive  computational  demands 
even  for  modest  mincers  of  targets  and  many  do  not  in¬ 
clude  the  most  difficult  part,  the  track  initiation. 

Away  to  reduce  the  computational  workload,  though 
not  commonly  used,  is  to  take  advantage  of  formation 
flying  aircrafts.  A  recent  paper  [7]  uses  an  initia- 
tionrrocess  bused  on  a  "general/ parallel  search  scheme" 
tj  find  parallel  flying  objects.  However,  the  method 
is  a  butch  method  using  5  to  s  scans  of  data  and  is  not 
further  used  in  the  succeding  tracking  process.  Early 
formation  tracking  concepts  can  be  found  in  [8]  to  [10], 
with  follow  ups  in  [11]  and  [12],  Formations  are  here 
somewhat  loosely  defined  as  a  set  of  returns  far  away 
enough  from  other  returns  not  to  cause  ambiguity  pro¬ 
blems.  The  generality  of  the  initiation  methods  pre¬ 
sented  in  [8]  and  [9]  respectively  are  also  difficult 
to  grasp.  In  [13]is  shown  that  the  maximum  likelihood 
solution  to  track  initiation  of  individual  tracks  in  a 
dense  detection  environment  is  unrealistic  in  real  time. 

The  group  concepts  of  these  papers  should  not  be 
mixed  up  with  the  "clustering"  used  in  e.g.  [4],  This 
Clustering  is  merely  a  way  to  order  the  returns  into 
independent  "clusters"  prior  to  applying  some  method 
for  finding  out  individual  tracks.  The  clusters 
themselves  arfcyiot  used  as  tracking  objects. 

The  approacnbvAus  paper  is  quite  different  from 
the  above  mentioned ?-*An  analysis  is  made  per  scan  of 
tne  received  returns  based  on  their  geometric  inter¬ 
relations  only.  From  this«a  large  scale  view  of  the 
tracking  and  the  data  received  can  be  taken.  Ultimately 
tne  ability  of  the  human  ooserver  in  identifying  target 
formations,  specific  ECM  patterns  etc.  would  be  desir¬ 
able.  However,  a  first  step  is  taken  with  the  objec¬ 
tive  so  make  feasible  tne  initiation  and  tracking  of 
large  groups  of  targets.  The  analysis  algorithm  devel- 
opectilms  tne  unique  feature  of  defining  a  nierarcy  of 
groups.  This  is  the  key  feature  both  for  its  use  in 
identification  as  wsll  as  in  the  initiation  and  crack¬ 
ing  processes  as  described  below.  The  method  sets  no 
limit  on  formation  size  and  tha  track  initiation  pnasa 
is  nandied  with  the  same  eaae  as  tracking  as  demons¬ 
trated  in  the  example.  The  method  is  believed  to  be  a 
good  oat is  for  multitarget  tracking  even  in  a  more 
realistic  radar  environment  and  with  other  kinds  of 
target  oehavior .  „^t  may  eitner  be  selfcantained  as  in 
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the  example  or  a  complement  to  hypothesis  methods. 

Tha  aaehod  used  is  nsuristic  dictated  by  its 
specific  requirements  and  the  discrete  kind  of  input 
data.  Not  ouch  can  be  gained  from  nearby  areas  such 
as  infra  rad  scans  analysis  [14],  rooot  vision  [IS]  or 
pattam  recognition  [161.  However,  the  concept  of 
"intraaet  distance"  used  in  section  2.1  in  this  paper 
is  found  in  [16] ,  though  differently  defined.  Pattern 
recognition  methods  will  be  of  further  use  in  tjie  simil¬ 
arity  correlation  process,  described  in  section  3.2. 

It  consists  of  raeogmzing  target  groups  in  successive 
scans,  subject  to  statistical  fluctuations  due  to  radar 
resolution  ar.d  dstectior.  .. reliability.  This  -..ill  is 
covered  m  following  work. 

2.  The  RSAA 

The  RSAA,  Recursive  Scene  Analysis  Algorithm,  has 
been  formulated  according  to  four  major  objectives  a a 
outlined  below. 

2.1  Groups 

The  first  object! vs  iss  find  groups  of  targets. 
However,  crucial  for  the  result  is  the  choice  of  group 
definition.  It  should  be  consistent  with  both  the 
target  formation  behavior  and  the  human  observer's  per¬ 
ception  of  target  groupings  in  s  mors  general  sense. 

A  heuristic,  non- probabilistic  definition  is  chosen  as 
follows: 

Definition:  A  group  is  a  set  of  eleaents,  groups  or 
single  targets,  with  a  maximum  intraset 
distance,  HID,  less  than  C  < < 1 >  times  the 
distance  to  its  nearest  neighbor,  DNN. 

where  MID  »  max  (dnn; ) 

i-l.N-1  1 


N 


the  numoer  of  targets  in  tne  group 


dnn.  ■  the  distance  between  tne  subset  SG  and 
i  i 

its  naarest  neighbor  SOT 

3G .  —  SG  —  MN 

l-l  1  1 

SG.  can  oe  cnosan  arbitrarily. 

i 

2.2  Hierarcy  of  Groups 

Tha  group  definition  allows  a  hiararcy  of  groups 
to  be  established.  The  purpose  of  this  is  twofold. 
First,  it  givss  a  structu ra  to  a  group  tnat  can  be  used 
both  for  pure  identification  out  also  for  tha  scan  to 
scan  corralation.  Second,  it  allows  tha  tracking  proc¬ 
ess  to  adjust  the  level  of  tracking  to  the  present  ac¬ 
curacy  of  the  tracking.  It  is  not  always  possible,  nor 
necessary  or  sven  desirable .  to  track  every  single  tar¬ 
get  individually.  This  is  clearly  demonstrated  in  the 
example. 
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2.3  Recursiveness 


Dm  BSAA  completes  an  analysis  of  tha  received 
radar  returns  par  each  coexisted  ancanna  revolution 
(scan) .  During  tha  scan#  as  tha  raturns  antar  tha 
radar,  tha  group  structura  is  updatad  rseursivsly. 

This  is  daaenstratad  .in  tha  example .  Tha  proeadura  is 
as  follows  for  avary  single  an taring  radar  raturns 

.  A  saarch  for  its  aaarast  neighbor,  NM. 

A  cast  for  tha  naw  raturn  to  aithar 

.  For*  a  pair  with  NS,  i.a.  a  naw  group 
.  Ba  ineludad  in  tha  saaa  group  as  NM 
.  Ba  ineludad.  not  in  tha  saaa  group,  but 
in  tha  supargroup  of  ns,  ate. 

An  analysis  of  tha  influanca  on  tha  aristing 
group  structura  by  racalculating  tha  MID  and 
DIM  for  affsctad  groups.  This  ean  laad  to 
aithar  • 

.  Forming  of  naw  groups 
.  Dismissing  of  axis ting  groups. 

3.4  Group  Data  Organization 

Tha  group  data  should  ba  organixad  for  coaputa- 
tional  efficiency.  This  naans  that  tha  data  should  ba 
chosan  to  specifically  support  tha  recursive  scheme  das* 
crib ad.  no  sore  data  should  ba  scored  than  are  fra* 
count lv  used  or  are  computationally  burdensome  to 
retrieve.  Tha  data  scored  are  for  each  group: 

.  Nusfcer  of  targets  in  group 
.  Group  level 
.  Group  center  coordinates 
NM  index 
.  ONN 
.  HID 

.  Supergroup  index 
.  Subgroup  indices 
.  Soma  tracking  logic 

3.  Tha  BSAA  in.  Multi  Target  Tracking 

3.1  General 

The  result  of  tha  BSAA  is  correlated  against  tha 
targets  in  tha  track  file.  Correlation  is  called 
aabiguous  If  two  or  more  objects  (groups  or  single 
raturns)  appear  in  tha  correlation  gate  of  any  of  tha 
trackad  objects.  The  basic  idea  behind  tha  uee  of  the 
RSAA  is  to  keep  tha  correlation  asfciguitiss  aa  faw  as 
possible.  This  is  achieved  in  two  ways.  An  object 
nay  ba  distinguished  from  another  by  naans  of  its  sis* 
and  structura  in  what  ia  called  tha  similarity  cor¬ 
relation  below,  xf  this  la  not  enough  tracking  is 
«ried  on  a  higher  group  level.  However,  alternatively 
(or  complementary)  hypothesis  based  methods  can  be 
applied  to  the  aatoiguou a  correlation  problem  with  the 
big  advantage  given  by  the  RSAA  that  were  reoccuring 
gzoupstructurea  can  be  found  these  can  be  tracked  as 
single  objects,  thus  reducing  substantially  tha  nuober 
of  hypothesis  necessary. 

3.2  Correlation  and  tracking  procedure 

The  correlation  procedure  used  is  in  three  stapei 

First  the  predicted  group  and  target  positions  on  tha 
tracking  level  of  the  trackflle  are  correlated  with 
the  group  centers  of  the  BSAA  on  the  corresponding 
level.  Xf  tha  oorrelatlcm  is  unaafciguous  tha  procedure 
advances  to  tha  second  end  third  step  for  continuation 
of  tracking  on  that  level  or  on  a  lower  level.  Xf  aa 
ambiguous  correlation  arise,  an  unafoiguous  correlation 
la  sought  on  a  higher  level  in  the  first  place. 


However,  other  options  are  available  as  indicated  is 
section  3.1. 

In  the  second  step  groups  are  correlated  for  sim¬ 
ilarity.  When  similarity  is  low,  measures  are  taken 
depending  on  the  nature  of  the  change.  Wien  similarity 
is  high,  continued  cracking  is  allowed  on  that  level. 
However,  the  third  step  checks  for  the  possibility  of  a 
more  detailed  tracking. 

Tha  third  stap  checks  for  unanbiguity  on  the  level 
below  the  actual  tracking  level.  This  allows  the  track¬ 
ing  to  be  transfered  to  lower  levels  of  tha  group  struc¬ 
ture  as  the  tracking  accuracy  improves.  This  is  of 
particular  value  in  the  crack  initiation  phase  as 
daseastratad  in  the  example. 

3.3  Dynamic  Scene  Analysis 

To  bettor  deserve  the  title  “Dynamic"  the  struc¬ 
ture  parameters  of  the  cracked  groups  are  monitored - 
over  a  period  of  times  more  than  two  acasis.  Parameters 
such  as  tha  nusbar  of  returns  and  the  exact  geometric 
structure  of  the  subgroups  are  subject  to  variations 
due  to  radar  detection  probability  and  resolution.  The 
range  and  nature  of  these  variations  should  be  known  If 
proper  identification  of  the  groups  are  to  be  dona. 

Tha  geometric  structure  is  of  course  also  affected 
by  formation  changes.  By  monitoring  structure  para¬ 
meter  changes,  in  relation  to  the  expected  variations 
due  to  the  radar  measurement  inaccuracies,  formation 
changes  may  be  detected  before  the  formation  elamants 
are  possible  to  track  individually. 

Three  group  levels  are  of  particular  interest i 

.  Tracking  level:  consistency  in  similarity 
correlation  parameters. 

.  Level  above  tracking  level:  preparation  of 
its  use  whan  conflicts  arise  on  tracking 
level. 

.  Level  below  tracking  level:  monitoring  out¬ 
breaks  and  group  splitting. 

4.  Example 

The  ideas  presented  above  are  demonstrated  on  a 
track  Initiation  case  with  32  targets  flying  in  forma¬ 
tion  as  shown  ia  Figure  1.  Figure  1  shows  s  cartesian 
north-east  coordinate  system  with  two  groups  of  sixteen 
targets,  each  of  which  consisting  of  four  groups  of 
four  targets.  Each  four-group  consists  ia  turn  of  two 
groups  of  two.  Distances  between  group  mexbers  are  aa 
shown  in  tha  figure.  All  targets  are  going  south  with 
a  spaed  of  200  m/s  maintaining  tha  formation  shown. 

The  targets  are  observed  by  *  radar  making  one 
scan,  from  west  to  east,  every  S  seconds.  Thus,  all 
targets  move  1000m  between  scans .  TO  damonstrata  the 
basic  idaaa  without  too  many  details,  ideal  radar  detec¬ 
tion,  accuracy  and  resolution  are  aesubbd. 

4.1  The  RSAA 

The  performance  of  the  RSAA  is  demonstrated  in 
figures  2  to  B.  As  idasl  radar  performance  is  assumed, 
identical  results  are  obtained  from  every  scan.  Only 
absolute  position  coordinates  are  changing,  due  to  tha 
speed  of  the  targets. 

Figure  2  shows  tha  group  of  two  formed  when  the 
first  two  returns  art  received.  The  third  return  has 
a  distance  from  the  previous  group  which  exceeds  what 
is  required  to  be  included  in  that  group.  The  constant 
C,  from  section  2.1,  is  chosen  to  .6.  instead  a  naw 
group  is  formsd  with  tha  last  return  and  the  previous 
group  as  subgroups,  as  shown  ia  Figure  3.  the  fourth 
return,  as  shown  in  figure  4,  forma  a  group  of  two  with 
tha  third  return  within  the  existing  supergroup  and  not 
affecting  the  first  group  of  two.  The  fifth  return 
results  in  a  new  supergroup  being  formsd  with  the  fifth 


5.  Conclusion* 


return  and  the  previous  group  of  four  as  subgroups,  as 
shown  in  flgura  S.  Now  four  levels  of  groups  hava  basn 
formed.  Figure  6  and  7  show  anothsr  css*  whsra  a  n*w 
subgroup  is  foraad  within  tha  highest  lsval  group  but 
only  af footing  a  part  of  tha  group  structur*.  Figure  3 
shows  tha  final  result  of  tha  RSAA  with  five  groups 
levels . 


Correlation  and  Tracking 


Figure  3  shows  what  la  seen  by  the  radar  after  the 
first  scan.  On  a  radar  screen  this  can  be  shown  at  any 
chosen  level  of  detail.  Her*  the  envelop*  of  the  highest 
group  level  and  Its  center  of  gravity  are  shown  la 
figure  9.  After  the  seoond  scan  the  saa*  return  data 
structur*  Is  found  by  the  RSAA  but  translated  1000*  to 
the  south.  According  to  the  correlation  procedure  ex¬ 
plained  In  section  3.2  a  position  correlation  la  first 
tried  on  tha  highest  group  level.  The  correlation  gats 
at  the  second  scan  consist  primarily  of  a  circle  of 
radius  T.v||M  (Tuscan  ties  and  tar  get  nariwia  speed) 

centered  at  the  first  scan  group  center.  Within  this 
circle  e  nonaebiguous  correlation  with  the  highest  lewd 
group  froa  the  second  scan  ia  made.  The  next  step  la 
the  correlation  procedure,  the  similarity  correlation, 
gives  a  perfect  match  between  the  two  groups .  This  ia 
due  to  the  ideal  measurement  conditions  and  that  no 
relative  motion  has  taken  place  within  the  group.  These 
two  steps  of  correlation  haver  now  proved  the  identity 
of  the  observed  groups  at  the  highest  level  and  thus 
tracking  is  allowed.  First,  however,  position  correla¬ 
tion  is  tried  on  the  level  below.  This  correlation 
falls  to  be  nonaabiguous.  Both  groups  of  the  second 
level  (groups  of  sixteen  targets)  fall  within  the  cor¬ 
relation  gate,  no  matter  froa  which  of  tha  first  scan 
groups  the  correlation  Is  triad.  Thus  tracking  stays 
on  the  first  level.  The  result  is  shown  in  figure  10. 
Tha  length  of  the  velocity  vector  la  chosen  to  shew 
the  predicted  position  of  tha  center  of  gravity  one 
scan  time  ahead. 

Tracking  is  performed  with  two  regular,  uncoupled, 
non- adaptive  Kalman  filters,  one  for  each  coordinate. 

The  covariances  of  che  Kalman  filters  are  used  to  detv 
aine  the  correlation  gates  In  the  usual  way.  The 
details  of  this  are  not  essential  to  the  present  case, 
and  not  shown  her*.  Important,  however,  is  the  general 
property  that  the  covariances  and  thus  tha  correlation 
gate,  decrease  with  increasing  scan  nuatoers .  They 
decrease  froa  the  initial  values  to  reach  a  steady  state 
plateau  determined  by  the  target  maneuver  and  measure¬ 
ment  accuracy  parameters.  Tha  result  of  the  decreasing 
correlation  gat*  is  shown  on  the  third  scan. 

At  the  third  scan  the  result  of  the  RSAA  is  cor¬ 
related  against  the  predicted  positions  of  the  track 
fils.  First,  again,  the  correlation  takes  place  on 
the  tracking  level.  Hare,  again,  the  position  correla¬ 
tion  is  nonaabiguous  and  the  similarity  correlation 
shows  s  perfect  match.  However,  in  the  third  step  of 
the  correlation  procedure  the  group*  on  the  level  helot 
tha  tracking  level  also  correlate  unambiguously  duo  to 
eh*  smaller  correlation  gate.  As  eh*  similarity  cor¬ 
relations  show  s  good  match  on  this  level  also,  the 
tracking  is  transferred  to  this  level.  This  is  don* 
prior  to  the  filter  update.  The  velocity  and  cov¬ 
ariance  data  of  the  tracking  level  are  given  to  the 
subgroups  and  their  filters  respectively.  This  results 
now  in  the  tracking  of  ths  two  groups  of  sixteen 
targets  as  shown  in  Figure  11. 

In  eh*  sane  way  the  tracking  accuracy  has  iag>  roved 
on  the  fourth  scan  to  allow  unaabiguous  correlation 
and  tracking  of  tha  groups  of  four,  as  shown  in  Figurs 
12.  In  eh*  fallowing  scans  the  increase  in  the  track¬ 
ing  accuracy  is  not  enough  to  permit  tracking  on  even 
lower  levels.  Figure  13  shows  the  repeated  tracking 
of  the  groups  of  four. 


— \  “ 

The  paper presented  a  radar  scene  analysis 

algorithm.  It  ' —  ' — - to  easily  cop*  with  track 

Initiation  of  a  large  formation  of  aircrafts,  a  problem 
giving  previous  methods  big  problems.  The  method  is  ' 
believed  to  be  a  general  multi  target  tracking  tool 
but  further  work  must  be  don*  to  include  a  more  realis¬ 
tic  radar  environment  and  other  kinds  of  target 
behavior. 
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